HYPERBOLIC ALEXANDROV-FENCHEL QUERMASSINTEGRAL 

INEQUALITIES II 
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Abstract. In this paper we first establish an optimal Sobolev type inequality for hypersurfaces 
in ]HI"(see Theorem II. If) . As an application we obtain hyperbolic Alexandrov-Fenchel inequal- 
ities for curvature integrals and quermassintegrals. Precisely, we prove a following geometric 
inequality in the hyperbolic space H", which is a hyperbolic Alexandrov-Fenchel inequality. 



0"2fc > Cn-iUJn 



ljJn-1 



+ 






provided that E is a horospherical convex, where 2k <n—\. Equality holds if and only if E is a 
geodesic sphere in H". Here Oj = o"j(k) is the j-ih mean curvature and k = {ki, K2, ■ ■ ■ , k„_i) 
is the set of the principal curvatures of E. Also, an optimal inequality for quermassintegrals in 
H" is as following: 
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provided that SI C H" is a domain with E = dQ. horospherical convex, where 2fc < n — 1. 
Equality holds if and only if E is a geodesic sphere in H". Here Wriyi) is quermassintegrals in 
integral geometry. 



o 



X 



1. Introduction 

In this paper we first establish Sobolev type inequalities for hypersurfaces in the hyperbolic 
space H". Let g be a Rieniannian metric on a Riemannian manifold. Its A;th Gauss-Bonnet 
curvature (or Lovelock curvature) L^ is defined by (see [13] for instance) 
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Here Rij is the Riemannian curvature with respect to g, and the generalized Kronecker delta 
is defined by 
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(1-4) Ag = ^ Ricg - iTTT^a 
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When k = 1, Li is just the scalar curvature R. When k = 2, it is the so-called (second) 
Gauss-Bonnet curvature 

L2 = WRmf-mRicf+R^, 

where Rm, Ric are the Riemannian curvature tensor, and the Ricci tensor with respect to 
g respectively. The Gauss-Bonnet curvature L^ is a very natural generalization of the scalar 
curvature. When the underlying manifold is local conformally flat, L^ equals to the cjjt-scalar 
curvature up to a constant multiple, precisely (cf. fT3]) 

(1.2) Lk = 2^k\{n - 1 - k){n - 2 - k) ■ ■ ■ {n - 2k)ak{g). 

Here the Ufc-scalar curvature was introduced in Viaclovsky [30] by 

(1-3) ak{g) ■■= (Jki^g), 

and kg is the set of the eigenvalues of the Schouten tensor Ag defined by 

n-3V ^ 2{n-2y 

Here we consider the (n — l)-dimensional manifold M with metric g. The Ufc-scalar curvature is 
also a very natural generalization of the scalar curvature R (in fact, C7i{g) = 2(n-2) -R^ ^^^ ^^® 
been intensively studied in the fully nonlinear Yamabe problem. The fully nonlinear Yamabe 
problem for u^ is a generalization of ordinary Yamabe problem for the scalar curvature R. In 
the ordinary Yamabe problem, the following functional, the so-called Yamabe functional, plays 
a crucial role 

n-3 f 

(1.5) J-i(5) = {vol{g))-—^ J Rgdf,{g). 

For a given conformal class [g] = {e^'^^g \ u G C°°(M)}, the Yamabe constant is defined by 

Y,{[g\)=iniFM- 

By the resolution of the Yamabe problem, Aubin and Schoen [21 [25] proved that for any metric 
g' on M 

(1.6)yi(b]) < Yi{[g^n-i\) and Yi{[g]) < yi(b§-i]) for any (M, [g]) other than [ffs„-i], 

where [(7§n-i] is the conformal class of the standard round metric on the sphere S"~^. From this, 
one can see the importance of the constant Yi ([(/§«-!]). In fact, one can prove that 

(1.7) yi([gs„-i]) = (n-l)(n-2)^^, 

where con-i is the volume of ggn-i. It is trivial to see that (|1.7p is equivalent to 

(1.8) I Lidii{g) = I Rgdi^ig) > (n - l)(n - 2)u^^volig)'^^ , 
Jm Jm 

for any g € [(/gn-i], which is in fact an optimal Sobolev inequality. See [20]. As a natural 

generalization, we proved in |,19j a generalized Sobolev inequality for Ufc-scalar curvature crk{g), 

which states 

(1-9) / ak{g)df,{g)>^u-\vol{g)^^, 
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for any g G Ck-i{[gsn-i]), where Cfc_i([g§n-i]) = [5§"-i] nr+_^ and T^ = {g\ aj{g) > 0, Vj < k} 

_ (n-l)! 
-1 ~ fc!(n-l-fc)! 



In this paper, we denote C^_i = ,,/",_, y . By (|1.2p inequahty ()1.9p can be written in the 



following form 



2k 
l2k /of^M , .n-l 



(1.10) J^Lkdfi{g) > CtU{2k)\ u-\{vol{g))^^, 

for any g G Cfc_i([(7§n-i]). We call both inequalities (|1.8p . (|1.10p optimal Soholev inequalities and 
would like to investigate which classes of metrics satisfy the optimal Sobolev inequalities. (11. Sp 
and (jl.lOp mean that a suitable subclass of the conformal class of the standard round metric 
satisfies the optimal Sobolev inequalities. From (I1.6P we know in any conformal class other than 
the conformal class of the standard round metric, there exist many metrics which do not satisfy 
the optimal Sobolev inequality. Hence it is natural to ask if there are other interesting classes 
of metrics satisfy the optimal Sobolev inequality? Observe that for a closed hypersurface S in 
M", 

(1.11) Lk = (2A;)!(72fc, 

where a2k is the 2A;-mean curvature of S, which is defined by 

aj = aj{K), 

where k = (ki, k.2,- ■ ■ , k„_i), kj (1 < j < n — 1) is the principal curvature of B, and B is the 2nd 
fundamental form of S induced by the standard Euclidean metric. The classical Alexandrov- 
Fenchel inequality (see |27] for instance) implies for convex hypersurfaces in M" that 

f C 2k „-l-2k 

(1.12) / Lkig)df^{g) = {2k)\ / <J2kdiJi{g) > Clti{2k)\ u;;il|E|^^^. 

I this paper we use |S| to denote the area of S with respect to the induced metric. Inequality 
()1.12p means that the induced metric of any convex hypersurfaces in M" satisfy the optimal 
Sobolev inequalities. The convexity can be weakened. See the work of Guan-Li [18j, Huisken 
[21] and Chang- Wang [6]. 

In this paper we prove that the induced metric of horospherical convex hypersurfaces in H" 
also satisfy the optimal Sobolev inequalities. 

Theorem 1.1. Let 2k < n — 1. Any horospherical convex hypersurfaces S in H" satisfies 



2k 

i2k /or^M , ,"-1 I 



n-l— 2fe 



(1.13) j^Lkdf^ig) > ctAm <--\\n 

equality holds if and only if T, is a geodesic sphere. 

A hypersurface in H" is horospherical convex if all principal curvatures are larger than or 
equal to 1. The horospherical convexity is a natural geometric concept, which is equivalent 
to the geometric convexity in Riemannian manifolds. For any hypersurface in H", the Gauss- 
Bonnet curvature L^ of the induced metric of the hypersurface can be expressed in terms of the 
curvature integrals by (see also Lemma l3. II below) 

(1-14) L, = CfL,{2k)\ J2i-iy -^cj2k-2r 

j=0 ^n-l 
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Comparing (J1.12p for M" with (J1.13p for H" and (jl.lip with (J1.14p , we obtain the same inequahty 
for Lk, while L^ has diferent expression in terms of the curvature integrals. We remark that 
when 2k = n — 1, ()1.13p is an equality for any hypersurface diffeomorphic to a sphere, i.e, 

Ln^dv(g) = in — l)\ujn-i- 

This follows that the Gauss-Bonnet-Chern theorem. 

As a first direct application, we establish Alexandrov-Fenchel type inequalities for curvature 
integrals. 

Theorem 1.2. Let 2k < n — 1. Any horospherical convex hypersurface E C H"' satisfies 

( \ 1 n-l-2fc \ fc 

2k \( \n\-^ 



(1-15) / CJ2k > C^ll^n-l U ^ + 



equality holds if and only if T. is a geodesic sphere. 

When k = 1 Theorem II. H and hence Theroem 11.21 is true even for any star-shaped and 
two-convex hypersurfaces in H", ie., o"i > and (72 > 0, which was proved by Li-Wei-Xiong in 
a recent work |22) . When k = 2, Theorem 11.11 was proved in our recent paper [15]. Due to the 
complication of the variational structure of J (t^ in the hyperbolic space, the case A: > 2 is quite 
different from the case k = 1. For case k>2 the horospherical convexity of the hypersurface S 
plays an essential role. 

At the end of this paper we show that a similar inequality holds for ai and propose a conjecture 
for general odd a2k+i- 

Another application is an optimal inequality for quermassintegrals in H". For a (geodesically) 
convex domain $7 C H" with S = dVt^ quermassintegrals are defined by 

(1.16) Wr{Q) := (^-^^''-i-'-^o f ^(^ ^ ^^^^^ 

where Cr is the space of r-dimensional totally geodesic subspaces L in H"', cor is the area of the 
r-dimensional standard round sphere and dL is the natural (invariant) measure on Cr (cf. |23], 
|28j). As in the Euclidean case we take Wo(ri) = Vol{il.). With these definitions, unlike the 
euclidean case, the quermassintegral in H" do not coincide with the mean curvature integrals, 
but they are closely related (cf. [28] ) 
(1.17) 

-^ [ ar = n (wr+i{n) + — ^pF^_i(fi)^ , Wo{n) = Voi{n), Wi{n) = -|s|. 

Cn_i JeV n-r + 1 ) n 

The relationship between Wq and W\^ the hyperbolic isoperimetric inequality, was established 
by Schmidt ^26j 70 years ago. When n = 2, the hyperbolic isoperimetric inequality is 

where L is the length of a curve 7 in H^ and A is the area of the enclosed domain by 7. In 
general, this hyperbolic isoperimetric inequality has no explicit form. There are many attempts 
to establish relationship between W\^(Q^ in the hyperbolic space H". See, for example. 
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and [29j. In [llj, Gallego-Solanes proved by using integral geometry the following interesting 
inequality for convex domains in H", precisely, there holds, 

77 — T 

(1.18) Wr{^) > Ws{^), r> s, 

n — s 

which implies 

(1.19) f akdfi > cC!^_^\J:\, 

where c = 1 if /c > 1 and c = (77, — 2)/(n — 1) if A; = 1 and |S| is the area of S. Here d/i is the 
area element of the induced metric. The constants in (jl.lSp and (J1.19p are optimal in the sense 
that one can not replace them by bigger constants. However, they are far away being optimal. 
As another application of Theorem ll.il we have the following optimal inequalities of Wk{^) 
for general odd k in terms of W-\ = - 1 S I . 

Theorem 1.3. Let 2k < n — 1. //il C H" be a domain with S = dQ horospherical convex, then 

where ujn-i is the area of the unit sphere §"^^. Equality holds if and only if T, is a geodesic 
sphere. 

As a direct corollary we solve an isoperimetric problem for horospherical convex surfaces with 
fixed Wi. 

Corollary 1.4. Let 2k < n — 1. In a class of horospherical convex hypersurfaces in H" with 
fixed Wi, the minimum ofW2k+i is achieved by and only by the geodesic spheres. 

Corollarv 11.41 answers a question asked in the paper of Gao, Hug and Schneider \TT\ in this 
case. 

In order to prove Theorem I l.H motivated by [T5] and [22] (see also [1] and [9]), we consider 
the following functional 



(1.21) Q(S) := |Sr^^^^ / Lfc. 

Here L^ is the Gauss-Bonnet curvature with respect to the induced metric (7 on S. This is a 
Yamabe type functional. One of crucial points of this paper is to show that functional Q is 
non-increasing under the following inverse curvature flow 

dT,t n — 2k aok-^ 

(1.22 — ^ = ^^-^i/, 

^ ^ dt 2k cj2fc 

where u is the outer normal of T,t, provided that the initial hypersurface is horospherical convex. 
One can show that horospherical convexity is preserved by flow (jl.22p . By the convergence 
results of Gerhardt [16] on the inverse curvature flow (jl.22p . we show that the flow approaches 
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to surfaces whose induced metrics belong to the conformal class of the standard round sphere 
metric. Therefore, we can use the result (ll.lOp to 

2k 

Q(S) > lim Q(St) > Cf_i(2A;)!u;„^. 

The rest of this paper is organized as follows. In Section 2 we present some basic facts 
about the elementary functions cr^ and recall the generalized Sobolev inequality (jl.lOp from 
|19j . In Section 3, We present the relationship between various geometric quantities including 
the intrinsic geometric quantities J^-, L^, the curvature integrals J^ a^ and the quermassintegrals 
Wr{^) ■ In Section 4 we prove the crucial monotonicity of Q and analyze its asymptotic behavior 
under flow (jl.22p . The proof of our main theorems are given in Section 5. In Section 6, we show 
that a similar inequality holds for cji and propose a conjecture for integral integrals (J2k+i- 

2. Preliminaries 
Let aj- be the fe-th elementary symmetry function a^ : M"~^ — > M defined by 

afc(A)= Y. ^^---K forA = (Ai,--- ,A„_i)GM"-\ 
n<---<ift 

For a symmetric matrix B, denote \{B) = (Ai(i?), • • • , Xn{B)) be the eigenvalues of B. We set 

ak{B) := ai,{X{B)). 

The Garding cone T~^ is defined as 

r+ = {A G M"^i I aj{A) > 0, Vj < k}. 

A symmetric matrix B is called belong to F^ if X{B) G F^. We collect the basic facts about 
(Tfc, which will be directly used in this paper. For other related facts, see a survey of Guan [T7] 
or [22]. 

(2-1) -^(B) = 1^6-^::-ii^...i^, 

where B = (¥■). In the following, for simplicity of notation we denote 



Pk 



r^k 



Lemma 2.1. For A G F^, we have the following Newton- MacLaurin inequalities 

(2.2) Pk^m^ < ^ 

Pk 

(2.3) ^i^^ > 1. 

Pk 

Moreover, equality holds in (|2.2p or ()2.3p at A if and only if A = c(l, 1, • • • ,1). 
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The Newton-MacLaurin inequalities play a very important role in proving geometric inequal- 
ities mentioned above. However, we will see that these inequalities are not precise enough to 
show our inequality ()1.13p . 

Let H" = M+ X S"^-*^ with the hyperbolic metric 

g = dr^ + sinh^ rg^n-i, 

where g^n-i is the standard round metric on the unit sphere §"~^ and S C H" a smooth closed 
hypersurface in H"' with a unit outward normal i'. Let h be the second fundamental form of S 
and K = (ki, • • • , k„_i) the set of principal curvatures of S in H" with respect to z^. The k-th 
mean curvature of S is defined by 

We now consider the following curvature evolution equation 
(2.4) |X = F.. 

where Sf = X{t, •) is a family of hyper surf aces in H", v is the unit outward normal to St = X{t, •) 
and F is a speed function which may depend on the position vector X and principal curvatures 
of Sj. One can check that |23) along the flow 



id/x, 



(2.5) — / akdfi ={k + 1) / F(Tfc+id/x + {n - k) j Fau^ 
and thus 

(2.6) — / Pkd^i= / {{n-k-l)pk+i + kpk-i)Fdn. 

If one compares flow ()2.4p in H" with a similar flow of hypersurfaces in R", the last term in ()2.5p 
is an extra term. This extra term comes from —1, the sectional curvature of H" and makes the 
phenomenon of H" quite different from the one of M". 
As mentioned above we use the following inverse flow 

(2.7) ^X = P^^i.. 

dt P2k 

By using the result of Gerhardt [16] we have 

Proposition 2.2. // the initial hypersurface S is horospherical convex, then the solution for 
the flow (12. 7p exists for all time t > and preservs the condition of horospherical convexity. 
Moreover, the hypersurfaces S^ become more and more umbilical in the sense of 

|V-V|<Ce~^, t>0, 

i.e., the principal curvatures are uniformly bounded and converge exponentially fast to one. Here 
hi-' = g hkj, where g is the induced metric and h is the second fundamental form. 

Proof. For the long time existence of the inverse curvature flow, see the work of Gerhardt [16] . 
The preservation of the horospherical convexity along flow (j2.7p was proved in [15j with the help 
of a maximal principle for tensors of Andrews [1] . D 
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Let g' be a Riemannian metric on M""^. Denote RiCg and Rg the Ricci tensor and the scalar 
curvature oi g respectively. The Schouten tensor Ag is defined by (11.4p .The cr/j-scalar curvature, 
which is introduced by Viaclovsky [30j, is defined by 

CTkig) ■■= crk{Ag). 

This is a natural generalization of the scalar curvature R. In fact, cri{g) = ^i -2) ^- R-^call that 
M is of dimension n — 1. We now consider the conformal class [5§n~i] of the standard sphere 
§"~^ and the following functionals defined by 



n-l— 2fc 

I 



(2.8) Fk{g)=vol{g) "-i / cjk{g)dfi, k = 0,1, ...,n - 1. 



If a metric g satisfies (Tj{g) > for any j < k, we call it /c-positive and denote g G T^. From 
Theorem l.A in [1^ we have 

Proposition 2.3. Let < k < ^^^ and g G [^gi-i] k-positive. We have 

(jk _2k_ 

(2.9) Tk{g) > J-fc(5sn-i) = ^^n"-l- 



Inequality <\2.9h is a generalized Sobolev inequality, since when k = I inequality (j2.9p is just 
the optimal Sobolev inequality. See for example |20]. For another Sobolev inequalities, see also 
[3] and [7]. 

3. Relationship between various geometric quantities 

The Gauss-Bonnet curvatures L^, and hence J^-, L^ are intrinsic geometric quantities, which 
depend only on the induced metric g on Y, and do not depend on the embeddings of (S,g). 
Lemma 13.21 and Lemma 13.31 below imply that a2k, /c2fc ^-nd W2k+i are also intrinsic. <72k+i, 
J o"2fc+i and W2k are extrinsic. The functionals /^ ^k are new geometric quantities for the 
study of the integral geometry in H". In this section we present the relationship between these 
geometric quantities. 

We first have a relation between Lk and cr^. 

Lemma 3.1. For a hypersurface {T,,g) in H", its Gauss-Bonnet curvature Lk can be expressed 
by higher order mean curvatures 

k 

(3.1) Lk = c'J_,{2ky.Y,ci{-lyp2k-2^■ 

1=0 

Hence we have 



(3.2) f Lk = Cl'_,{2k)lY,Cl{-iy f P2k-2^ = Cl'L,{2k)lY,i-lyy^J 

Proof. First recall the Gauss formula 

Rij^' = {h,^h/ - h/hj^) - {di^'d/ - 5Uh^ 



0'2k-2i- 
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where /ij-' := g^^hj^j and h is the second fundamental form. Then substituting the Gauss formula 
above into (11. ip and recalling (j2.ip . we have by a straightforward calculation, 

-^« 2^= ■^'l-'2'"-'2'=-l-?2'= *1*2 ^^2k-lt2k 

_ rn«2---«2fc-l«2fc /T Ji7 J2 _ X. jlX. h\ . . . ( h ■ hk-lh- hk _ X. J2k-lX. J2k\ 

~ jlJ2---J2k-lJ2k^ ^^ *2 "H "12 I \"'l2k-l "'*2fc "«2fc-l "*2fc / 



^ Cl{-iy{n - 2/c)(n - 2/c + 1) • • • (n - 1 - 2/c + 2i) ((2/c - 2i)la2k-2i 

i=0 

k 

ci'L,{2k)ij2ci{-iyp2k^2i. 



i=0 



Here in the second equality we use the symmetry of generalized Kronecker delta and in the third 
equality we use ()2.ip and the basic property of generalized Kronecker delta 



(3-3) ^::ViIA'"=^-P^^: 

which follows from the Laplace expansion of determinant. 



«2«3---«p 
J2J3---jp^ 



D 



Motivated by the expression (|3.ip . we introduce the following notations, 

k k 

(3.4) Lk = Y^ Ci{-lyp2k-2^, Nk = J2 Ci{-iyP2k^2i+l. 

i=0 i=0 

It is clear that 

Lk = {2ky.Cl'LiLk, Nk = {2ky.Cl\Nk. 

Lemma 3.2. We have 

(3.5) a2k = Cf_,P2k = Cf_, [ J2 CIL^ , 
and hence 



rt fin rt 1 /* 



i=0 ^ ^ ' i=0 

To show Theorem 1 1 . 3 1 b elow . we need 



Lemma 3.3. The quermassintegral W2k+i can be expressed in terms of integral of Li 

1 J^ n — ^ —Ik r ~ 

(3.6) W2k+im = -Y. Ci r^r-^ / Lk-^. 

n ^-^ n — 1 — 2k + 2i Jy^ 
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Proof. We use the induction argument to show ()3.6p . When k = 0, we have by (|1.17p that 
Wi{Q) = -|S|. We then assume that (j3.6p holds for k — 1, that is 



n ^ '^^n + l-2/c + 2j •' 

(^7) - ^ fv^.-i n + l-2k ~ 

-'^ i=l 

By (fTTTD and ^^, we have 

W2k+im = - P2k — ——-W2k-im 

k 

n Y ^-^ n — zk + 1 

Substituting ()3.7p into above, one immediately obtains ()3.6p for k. Thus we complete the 
proof. D 

One can also show the following relation between the quermassintegrals and the curvature 
integrals. 

Lemma 3.4. 

(■^R\ w (o\ ly-r iv {2ky.i{n-2k-i)i\ i r 

(3.8) w,k+,{n) = - }j-iy ^^^ _ 2^.^,,^^ _ 2fc _ 1 + 2i)!! cf_f ^- i ""''-'^^ 

where 

{2k-iy.\ ■.= {2k-l){2k-3)---l and {2k)\\ := {2k){2k -2) ■ ■ -2. 

Proof. One can show this relation by a direct computation. See also (24] or [29]. D 



4. MONOTONICITY 

In this section we prove the monotonicity of functional Q under inverse curvature flow. First, 
we have the variational formula for /ifc- 

Lemma 4.1. Along the inverse flow \2.T^ , we have 

(4.1) ^ f Lk = {n-l-2k) fLk + {n-l-2k) f (iV^^^^-Z^ 

at Js J Js ^ P2k 
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Proof. It follows from (j2.6p that along the inverse flow (j2.4p . we have 

k 



^^ I Lk = I Yl Ci{-iy[{n -l-2k + 2i)p2k-2i+i + 2{k - i)p2k~2i^i)F 

= / E cii-^yi^ -i-2k+ 2i)p2k-2i+iF + Yl ci-\-iy~^2{k - j + i)P2k-2j+iF 

= Yci{-ly{n-l-2k)p2k-2^+lF+ / Y^{-iy[ciJ-Ci~\k-j + l))p2k-2HiF 

•^^ i=0 ''^ j=l 

={n-l-2k) j j2ci{-lyp2k-2^+l 
=(n - 1 - 2k) j NkF 

=(n-l- 2k) f Lk + in-1- 2k) j [n^F - L^). 
Substituting F = ?2h^^ into above, we get the desired result. D 



P2k 

In order to show the monotonicity of the functional Q defined in (|1.21|) under the inverse flow 
()2.7|) . we need to show the non-positivity of the last term in (I4.ip . That is 

(4.2) ^^^^Nk -Lk<0. 

P2k 

When k = l, ([12]) is just 

— {P3 -Pi) - (P2 - 1) < 0, 

P2 

which follows from the Newton-Maclaurin inequalities in Lemma |2.1[ In fact, it is clear that 

Pif ^ / IN fPiPs N , ., pI. 

— iP3 - Pi) - [P2 - I) = ( P2 +(1 • 

P2 P2 P2 

Hence the non-positivity follows, for both terms are non-positive, by Lemma l2.1i This was used 
in [22]. When k > 2, the proof of (j4.2p becomes more complicated. When k = 2, one needs to 
show the non-positivity of 

(4.3) ^(p5 - 2p3+pi) - (pa - 2p2 + 1) = (-P5-P4) +2(p2-^) + (-P1 - lY 

PA Kpa j V paJ Vp4 / 

By Lemma l2. 11 the flrst two terms are non-positive, but the last term is non-negative. It was 
showed in [T2| that (|4.3p is non-positive if k € M"~^ satisfying 

(4.4) AC e {k = (ki, ^2, • • • , Kn^l) € M""^ | Ki > 1}. 

We want to show that (j4.2p is true for general k < ^{n — 1). This is one of key points of this 
paper. Now the case is more complicated than the case k = 2. 
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Proposition 4.2. For any k satisfying i4-4^ > '^^ have 

(4.5) ?^^^Nk - Lfc < 0. 

P2k 

Equality holds if and only if one of the following two cases holds 

(4.6) either (i) Ki = Kj yi,j, or (ii) 3 i with Ki < 1 &i Kj = 1 \/j ^ i. 

We sketch the proof into several steps. Before the proof, we introduce the notation of ^ to 

eye 

simphfy notations. Precisely, given n— 1 numbers (ki, K2, • • • , k„_i), we denote ^ fi^i, • • • , Kn-i) 

eye 

the cyclic summation which takes over all different terms of the type /(ki, • • • , Kn-i)- For in- 
stance. 



n-l 

'3 }■> 



^ Ki = Ki + K2 H h Kn-1, ^ KlK2 = ^ y^ ^ H, 

eye eye i=l j^i 

n-l 



i=l ^ l<j<fc<n-l -^^ 

(n — 3) N^ K1K2 — 6 N^ K1K2K3. 



eye i=l ^ l<j<fc<n— 1 



eye eye 

Lemraa 4.3. For any k satisfying |^.^[ ), we have 

(4.7) ^fc-m^fc<0. 
Equality holds if and only if one of the following two cases holds 

either (i) Ki = kj yi,j, or (ii) 3i with Hi > l&i kj = 1 Vj 7^ i. 
Proof. It is crucial to observe that (14. Th is indeed equivalent to the following inequality: 

(4.8) 2_^ Ki^lKi^Ki.^ — 1)(Kj^Kj5 — 1) • • • (,K'i2k-2^i2k-l ~ ^JK'^hk ~ ^hk+l) — ^i 
l<im<n-l,ij^il{jjtl) 

where the summation takes over all the {2k + l)-elements permutation of {1, 2, • • • , n — 1}. For 
the convenience of the reader, we sketch the proof of (j4.8p briefly. First, note that from ()3.4p 
that 

k k 

{piLk-m = pi^c^x-i)'->2i-i;c^x-i)'">2i+i 

i=0 i=0 

k 

i=0 

Next we calculate each term piP2i — P2i+i carefully. By using 

(n - l)Ci_, = (j + l)Cit\ + (n - l)Ci-_\), 
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we have 



^ eye ' ^ eye ^ 



^12 ' ' ' ^ii ) 



■J 
eye ' eye 



and 



V\V2i - P2J+1 

1 . . 

(n-l)Cei 



2j \ A^ ^*l '^*2 ■ ■ ■ '^«2j ) ( 2^ ^«2j + l j ^2i + l 2^ '^«1 ^«2 ■ ■ ■ "'J2J + 1 

ct/c ^ ^ cvc n— 1 ci/c 



(n 



,N^^2j ^2j+l y-'n-l \^J + 1) 2^ 1^111^12 ■ ■ ■ '^i2j'^i2j+l + C'„_i _2^ '^ij '^J2 " " " ^i2j 
/ n— 1 n— 1 CHC eye 



-(n — ljG^_-|^ ^ ^ Ki-^Ki^ ■ ■ ■ K; 



cj/c cj;c 



eye 

r^2i+i 



/ J ^Ji '^i2 ■ ■ ■ '^i2j-l V'^i2j '*«2j + l J 



;n - Lj - Ly. Y^ _ 2 



(2j)!(n-2i-2)! 

In (j4.8p . the coefficient of k\K2 ■ ■ ■ K2j-i{k2j — K2j+i)^ is 

2{-l)''-^CiZl{2j - l)\Cl%]l^[2{k - j)]\ = t}^ci{2j)\{n - 2j - 2)! 

_/ .^k-,^j mKn-2j-2y. (n-l)-(n-l)! 
^ ' '^ (n - 1) • (n - 1)! k 

Therefore we have 

< 2_^ ^{-^{Ki^Ki^ — 1)(«;j4«;j5 — 1) • • • \K'i2k-2^i2k-l ~ ^)\'^i2k ~ ^«2fe+lj 

(n — 1) • (n — 1)! v-^, ,,i,_i„j, , 

= ^ V E(-l) '^^(^1^2, -P2,+1) 

i=o 

(n-l)-(n-l)! , ~ ~ 
= j^ {PiLk - Nk). 

This finishes the proof. D 



In view of (j4.8p . we have the following remark which will be used later. 
Remark 4.4. For any k = (ki,--- ,k„_i) satisfying < kj < 1, (i = 1, • • • ,?i — 1), then 

(-i)'=-i(iVfc-piZ,,)<o. 
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Lemma 4.5. For any k satisfying ^■4\ ), we have 

Nk > 0, Lk > 0. 
Proof. They are equivalent to the following inequalities respectively: 

(4.9) Y^ Ki^iKi^Ki., - l)(Ki4Ki5 -!)••• (Ki2,„2Ki2,_^ - l)(Ki2feKi2,+ i - 1) > 0, 
l<im.<n~l,ij^il{jytl) 

(4.10) 2_^ (KijKis — 1)(Kj4Kj5 — 1) • • • \K'i2k-2^i2k-l ~ -'^)(^«2fe^«2fe+l ~ 1) ^ 0. 

where the summation takes over all the {2k + l)-elements permutation of {1, 2, • • • , n — 1}. The 
proof to show the equivalence of (j4.9p , (|4.1Up is exactly the same as the one of (|4.8p . Hence we 
omit it here. D 

Remark 4.6. For any k = (ki,--- ,k„_i) satisfying < Kj < 1, (z = 1, ■ ■ ■ ,n — 1), then 
i-l)''Nk>0,{-l)^Lk>0. 

Making use of Lemma [4.3l and Remark l4.4l we can show the following result which is stronger 
than Proposition 14.21 



Lemma 4.7. For any k satisfying |^.^[ ), we have 

V2kNk - P2k+iLk < 0. 

Proof. According to the induction argument proved in [15] (see p. 8), we only need to prove it 
for n — 1 = 2A; + 1. Let Zi = — < 1, and 

Pi =Piizi,Z2,--- ,Z2k+l)- 

It is clear that 

(4.11) p, = P^^±^. 

P2k+1 

By Remark 14.41 we have 

k k 

(4.12) (-1)'=-! Y. Ci{-l)%k-2r+l - {-lf~'pi E Ci{-l)%U-2^ < 0, 

i=0 i=0 

which is equivalent to 

k k 

(4.13) {-!)''-' Y cii-iy^^ - {-if-^^^ Yl cii-iy^^^ < 0. 



i=0 P2k+1 P2k+l ^ P2k+l 



Thus we have 



(4.14) Y cii-^f-'m -^^Y cU-l)'-'P2^+l > 0, 

which implies -^^^Nk - Lfe < 0. D 
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Proof of Proposition \4-^ Then by the Newton-MacLaurin inequahty P2k-iP2k+i < P^fc' ^^ 
obtain 

^^^^Nk - Lk < -^^^Nk -Lk<0, 

P2k P2k+1 

which is exactly ()4.5p . Here we have used Lemma |4.5[ D 

Remark 4.8. Proposition \4-^ holds for k G M"^-'^ with KiKj > 1 for any i,j. This is equivalent 



^3 

to the condition that the sectional curvature of S is non-negative. 



Remark 4.9. From the proof of Proposition \4-^ it is easy to see that ()4.5p has an inverse 
inequality for k G IR"'^-'^ with < Kj < 1. 

Now we have a monotonicity of Q(St) defined by ()1.2ip under the flow ([2 



Theorem 4.10. Functional Q is non-increasing under the flow (12. 7p . provided that the initial 
surface is horospherical convex. 

Proof It follows from ([33]), ([33]) and Proposition SJ] that 
(4.15) ^fLk<in-l-2k)fLk. 

On the other hand, by (j2.6p and (j2.3p . we also have 



(4.16) -^|E,| = / ?^^{n - l)pid/i > (n - l)|St|. 

at JY.t P2k 

Combining (j4.15p and (|4.16p together, we complete the proof. 

D 

Remark 4.11. From the above proof, one can check that to obtain a monotonicity of Q it is 
enough to choose F = -j- . Then from |^.iD and ( f^.Tj ), it holds for all k 

^ / Lfc =(n -2k-l) fLk + in-2k- 1) (-iV^ - Lk 
<(n-2k- 1) / Lk. 



5. Proof of main Theorems 
Now we are ready to show our main theorems. 

Proof of Theorem \1.1[ First recall the definition p.2ip of the functional Q , (jl.lSp is equivalent 
to 

(5.1) Q(S)>Cf_i(2A:)!u;;-. 

Let S(t) be a solution of flow (j2.7p obtained by the work of Gerhardt [1^. This flow preserves 
the horospherical convexity and non-increases for the functional Q. Hence, to show (15. ip we 
only need to show 

2fc 

(5.2) limQ(Et)>Cf_i(2A;)!a;;zi. 
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Since S is a horospherical convex hypersurface in (H",^), it is written as graph of function 
r{9), 9 G S"~"^. We denote X{t) as graphs r{t,6) on S*^"^ with the standard metric g. We set 
A(r) = sinh(r) and we have A'(r) = cosh(r). It is clear that 

(X'f = (A)2 + 1. 
We define ip{6) = $(r(6')). Here $ verifies 

We define another function 

V = 

By [H], we have the fohowing results. 

Lemma 5.1. 

A = 0(e^), |Vv9| + |VVl = 0(e~^). 

From Lemma (|5.ip . we have the following expansions: 

(5.3) A' = A(l + iA-2)+0(e-^), 



1 + |V(^|?. 



and 

2 



1 ^ 1—2 - • -^^ 



(5.4) _ = l__|Vy,|| + 0(e- — ; 



We have also 
(5.5) VA = AA'Vc^. 

The second fundamental form of S is written in an orthogonal basis (see [10] for example) 



h.^ = ^ V-^ + 



V + (tt^ - ^|V^P)V - ^ + 0(e-^), 



t;A V"" A' v'^X' 



where the second equality follows from (j5.3|) and (j5.4|) . We set 



(5.6) r,^- = (^-i|Vv.p)V-^, 

then from the Gauss equations, we obtain 

= 6i%^ + Ti''6/ - T/6j'' - 6i%'' + 0(e-^). 
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It follows from (jl.ip that 

r, — J_A*l*2---«2fe-l*2fc o. . jlJ2 . . . D. . J2k-lJ2k 

^^ 2fe"jlJ2---i2fe-li2fe^*l*2 -^«2fc-l«2fc 

■ • • ■ (2fc + 2)t 

_ f)fci:»l«2---«2fc-l«2fe TH. ji e J2 . . . 7^. J2fc-1 A. i2fc _|_ 0(p S^Tl— ^ 

~ ^ °iii2-i2fc-ii2fc »i "*2 ^*2fe-i «»2fc +^ye ) 

-■-■,■ . . . (2fc+2)t 

= 2k(^n -l-k)...{n- 2A;)5;^ J.:;-:\r,,^iT,3.^3 . . . r,,,_,^--. + ©(e'^T^) 

(2fc+2)i 

= 2'=A:!(n - 1 - A;) • • • (n - 2k)ak(T) + 0(e ^^^). 
Here in the second equality we use the fact 

r«l«2---«2fc-l«2fc rp ji r J2 rn*2---«2fe-li2fc r jirp J2 

"jlJ2-J2k-lJ2k "-^ "*2 - "jlJ2-J2k-lhk°^^ *2 

_ r«l*2---i2fe-l*2fc TH J2X ii _r*i*2---i2fc-i«2fe r 727^ jl 

~ "ili2-i2fc-li2fc *1 "«2 — ''jli2---i2fc-li2fc *1 -^«2 ) 



and in the third equality we use (j2.ip and (j3.3 
Recall ifi = Xi/XX' , then by (j5.3p we have 

By the definition of the Schouten tensor 



(5.7) ^. = ^-^ + 0(6-^). 



1 /^o- ^9 -.A 1-. 

Its conformal transformation formula is well-known (see for example |30) ) 

, , , V^A 2VAOVA 1|VA|\ , V^A 2VA ® VA 1 IVAP ^ 1, 

(5.8) ^A2, = -^ + ^^^-2^^. + ^, = -^ + ^^, 2^^^+ 2^- 

Substituting (|5.5p and (|5.7p into (|5.6p . together with (|5.8p . we have 

Ti = {{X^g)-'A^2^)/ +0{e-^^), 
which implies 

, (2fe+2)i 

(5.9) Lk = 2^k\{n - 1 - A;) ... (n - 2k)ak{Ay^2g) + 0{e-^^). 

As before, E(i) is a horospherical convex hypersurface. As a consequence, S has the nonnegative 

sectional curvature so that T + 0(e "-i) is positive definite. We consider A := A " and 
the conformal metric y?g. We have 

X\X'g) ^A-^2g = -e "-i/ + -e "-i(l-e n-i)^^/-e -i (1 - e -^r? j^ 

+X\l-e-^^)iX^gr'A^2^. 

Recall ie^^^^/ + A^(l - e"^^^^){X'^g)~^Ax2g G T^^^ for the sufficiently large t and ie~^^^^(l - 
e-Ti:^ )Igy / - e'^ (1 - e~^)ff-^ VA^VA ^ f+ for any k<^. Therefore, we infer X^g G r+ 
for any k < ^^. The Sobolev inequality (12. 9p for the ak operator gives 



(5.10) {vol{X^g)r^^ / ^^(^3^2 Jc?«o/^2g > 



2fe 



-r. . n-\~2k f (n—l)---(n — k) 7- 

'^"^^ —^ I - ' ^^Mvoh2'>- —r-rr- """ 
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On the other hand, we have 

n-l-2fc 

since 

^-e-^ =l + o(l). 

As a consequence of (|5.9p . (|5.10p and (|5.1ip . we deduce 

n-l-2fc 



2fc 



hm (w/(S(t))) ^^^ / Lfc > (n - l)(n - 2) • • • (n - 2A;)w;'lJ. 
*^+°° Js(t) 

When (jS.ip is an equality, then Q is constant along the flow. Then ()4.16[) is an equality, which 
implies that equality in the inequality 

P2k-1 . , 
Pi > 1, 

P2k 

holds. Therefore, S is a geodesic sphere. D 

Proof of Theorem \1.2[ It follows from (j3.ip , (j3.4p and Theorem 11.11 that when n — 1 > 2k 

f ~ -2i^ n-l-2fc 

(5.12) J^Lk>u;:z\m)^^. 

Using the expression (j3.5p of /^ '^fc in terms of /^ -Lj we get the desired result 

(1 ,1 n-l-2k ^ fc 

(^±r + (1± 
\UJn-lJ V^n-1 



/. 



By Theorem II. H equality holds if and only if S is a geodesic sphere. 

When n — 1 = 2k, since the hypersurface S is convex, we know that p.l3p is an equality 
when n — 1 = 2A; by the Gauss-Bonnet-Chern theorem, even for any hypersurface diffeomorphic 
to a sphere. Hence in this case, we also have all the above inequalities with equality which in 
turn implies by [22] or [15] that S is a geodesic sphere. D 



Proof of Theorem \1.3[ When n — 1 > 2k, the proof follows directly from (j5.12p and Lemma [ 
When n — 1 = 2k, the proof follows by the same reason as in Theorem 11.21 D 

From (I1.17P , it is easy to see that Theorem 11.31 implies Theorem 11.21 meanwhile Theorem 11.21 
may not directly imply Theorem 11.31 since there are negative coefficients in ()3.8p above. 

6. Alexandrov-Fenchel inequality for odd k 

In this section, we show an Alexandrov-Fenchel inequality for ai, which follows from the result 
of Cheng-Zhou |8] and Theorem 11.21 (or more precisely from |22j). 
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Theorem 6.1. Let n > 2. Any horospherical convex hyper surf ace S C H" satisfies 
(6.1) / ai >(n-lK_i<^ {^^] + 



where oJn-i is the area of the unit sphere W"^"^ and |S[ is the area ofT,. Equality holds if and 
only ifTi is a geodesic sphere. 

Proof. Notice that the horospherical convex condition imphes that the Ricci curvature of S is 
non-negative. We observe first that by a direct computation (1.4) in [8] 

s n-2 Jy: n-1 

is equivalent to 

Then we use the optimal inequality for (T2 proved in [22J (see also Theorem 1.2), 

(6.3) £..> '"-^f-^' (.„^iE|a + iE 



to obtain the desired inequality for ui, 



„ 2(n-2) 1 



(Ti > (n - l)w„_i< + 

S I \Wn-l/ V^n-1 

When (j6.ip is an equality, in turn, (j6.3p is also a equality, then it follows from [22] that the 
hypersurface is a geodesic sphere. D 

Motivated by Theorem 11.21 and (j6.2p . we would like propose the following 
Conjecture 6.2. Let n — 1 > 2k + 1. Any horospherical convex hypersurface S C H" satisfies 

2 2 (n~2fc-2) 2fc+l 



Equality holds if and only if Y, is a geodesic sphere. 

The conjecture follows from Theorem 11.21 and the following conjecture 



(6-4) ^2fc+2^2fc / "^2^+2 / f^2fc < ( / f^2fc+l ) • 
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